Which measures of spin-glass overlaps are informative? 
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The nature of equilibrium states in disordered materials is often studied using an overlap function 
P(g), the probability of two configurations having a similarity q. Exact sampling simulations of a 
two-dimensional proxy for three-dimensional spin glasses indicate that common measures of P{q) 
are inconclusive for systems of linear size L < 64. Strong corrections result from P{q) being an 
average over many scales, as seen in a toy droplet model. Ifowever, the median I{q) of the integrals 
of sample-dependent P{q) curves shows promise for deciding the large size behavior. 



Materials with quenched disorder have equilibrium and 
dynamic behaviors that differ qualitatively from those for 
homogeneous materials. The lack of translation invari- 
ance leads to a more complex free energy "landscape" 
and to very slow, i.e., glassy, dynamics. In order to ex- 
plain the glassiness that is observed in experiment and 
predicted by simulations, it is necessary to understand 
the equilibrium states approached by relaxation. The 
most studied model of disordered systems in statistical 
mechanics is the spin glass, where the couplings between 
nearby spins are randomly set to be ferromagnetic or 
antiferromagnetic. This model serves as a primary ex- 
ample for studying a wide range of disordered materials 
and more general problems, including hard optimization 
problems and neural networks pQ [5] . Theoretical char- 
acterizations of spin glass equilibrium states include the 
replica symmetry breaking (RSB) description which 
is based on the solution of mean-field models [1], and 
the droplet picture [SH7], which is based on a scaling de- 
scription. These each rely on quite distinct pictures of 
equilibrium: in the former, a countably infinite number 
of thermodynamic states are relevant, while in the latter 
there is a single state, up to global symmetries. Though 
RSB-based predictions for free energies have been rig- 
orously verified in mean field models [S], analytic veri- 
fication of either characterization has not been possible 
in three dimensions [9] and numerical work is generally 
very difficult due to the glassy dynamics. 

To reliably determine the thermodynamic states in 
models of disordered materials, it would be useful to 
extrapolate simulation results to the large system limit 
with confidence. One characterization of the structure 
of states is the probability distribution P{q), where q is 
a measure of the similarity of two equilibrium configu- 
rations and the distribution is an average over disorder 
realizations J^. This distribution is not a complete char- 
acterization of the equilibrium states [TOl [11] , but numer- 
ical calculation of P{q) has been used as a classic test to 
discriminate between many-state pictures such as RSB 
and pictures such as the droplet model. For large systems 
with non-contrived boundary conditions [12| , the droplet 
model predicts that P{q) approaches a single delta func- 
tion S{q — (Jea) for Edwards- Anderson order parameter 
qEAy while in many-state pictures such as RSB pictures, 



the distribution P{q) has additional integrated weight 
over intervals of q that don't include (?ea- 

This paper presents explorations of which measures of 
the distribution P{q) and of the distributions for individ- 
ual samples, Pj[q), can be used to clearly decide between 
alternate pictures of the thermodynamic states. The 
focus is on determining whether there is non-vanishing 
probability of seeing macroscopically distinct states in 
the large system limit. I present numerical results for 
the two-dimensional (2D) ± J Ising spin glass at zero tem- 
perature. This model has been argued [13j to be a useful 
proxy for the glassy phase of the three-dimensional Ising 
(3D) spin glass. In the 2D ± J model, a large number of 
degenerate configurations exist at all scales, but entropic 
effects suppress the effects of this degeneracy at large 
scales, just as large scale excitations are suppressed by 
large free-energy costs within the droplet model for 3D 
spin glasses at low enough temperatures T < T^^. The 
advantage of the two-dimensional model is that config- 
urations can be exactly sampled for relatively large 
linear sizes L < 256. The sample average of P{q) near 
q = varies slowly with L for L « 10, resembling the 
results [151 116j for three- and four-dimensional Ising spin 
glasses that would appear to support a many-states pic- 
ture. However, agreement with droplet scaling expecta- 
tions is seen in the 2D model for L > 64. 

The slow convergence to the asymptotic behavior is ar- 
gued to result from the contributions from many scales 
to the distribution P{q). This is demonstrated using 
a toy droplet model. In this model, using parameters 
in line with those for the 3D model, P{q) at small q 
is nearly constant for L < 512. This supports gener- 
ally being very wary in relying on the averaged P{q) for 
smaller systems. A measure of Pj{q), namely the me- 
dian I{q) over samples of the cumulative distribution 
Ij{q) — Jq Pj{q')dq' , is proposed to more clearly predict 
the thermodynamic limit from small numerical samples. 

A recently introduced statistic [T7], A(k, qg, L), is also 
investigated. This statistic is a measure of the probabil- 
ity of peaks at small q < qo and is nearly independent of 
system size in 3D models [17 . In the 2D bimodal simula- 
tions, this lack of dependence on L appears to result from 
a combination of fewer peaks in Pj{q) and a sharpening 
of the peaks as L increases |T5]. The probability that a 
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peak exceeds a threshold k may then be relatively insen- 
sitive to L, though there is only one state. So though A 
may in practice distinguish mean field from 3D models 
[T7] . this measure requires cautious use. 

Spin glass overlap. In the Ising spin glass T^, the 
configurations arc sets of spin values s — {si} indexed by 
i — 1 . . . N and = ±1 for each spin. Spin configurations 
s for a realization J' have a probability p{s) oc e~'^^^'^^^'^ 
for a sample-dependent Hamiltonian H j. The spin over- 
lap distribution Pj{q) for a single sample J is then just 
the probability density for the absolute value of the spin 
overlap q = "^ -^^ s] sf , over independently chosen 
spin configurations ^,5. As different samples each have 
distinct couplings Jij between spins i and j, Pj(q) de- 
pends on the coupling realization — {Jij} as well as the 
temperature T. The distribution P{q) is the average of 
Pj{q) over samples J . Using P{q) to characterize states 
is natural, as P{q) simply gives the probability of a given 
overlap q between pairs of equilibrium configurations in 
a randomly chosen sample. Despite the clear difference 
in the predictions resulting from RSB calculations and 
droplet models, it has been difficult to determine numer- 
ically the infinite size limit of P{q)- Simulations of spin 
glasses are difficult due to the extremely long equilibra- 
tion times for Markov Chain Monte Carlo methods [20] . 
so that simulations in three dimensions for more than 
12^ spins are quite challenging. It has also been argued 
that simulations just below the spin-glass temperature 
Tg^ suffer from large correlation lengths that make sim- 
ulations inconclusive j21j. 

2D Model. Distributions Pj{q) were computed for 
a two-dimensional bimodal (i.e., ±J) spin glass in the 
limit T — 0. Model samples have N = L x L spins ar- 
ranged on a square lattice with toroidal (periodic) bound- 
ary conditions. A sample realization J7 = {Jij} is de- 
scribed by couplings Jij which are zero except for neigh- 
boring sites (j,j), where = ±1 with equal probabil- 
ity. The Edwards- Anderson Hamiltonian [TH] \s T-Lj — 
— ^f^iJijSiSj. Pfaffian sampling techniques [14] were 
used to generate configurations s = {si} with equilibrium 
probability Z''^e~f^'^^'^'\ with fi = T'^ and Z(/3) the 
partition function. The value of /3 was set high enough 
that equilibrium sampling chooses ground state configu- 
rations (Table I lists the values of ^ used in production 
runs). For a given JT", all m (Table I) generated configu- 
rations had the same energy "Kj. Additionally, test runs 
with /3 at least twice as high as the production /? gave 
the same energy for each J . This gives high confidence 
that the production runs generate the ground states for 
each sample. For each realization J ^ spin overlaps q were 
computed for all pairs of configurations to esti- 

mate Pj{q). To validate the procedure and to generate 
configurations, 1.3 x 10® h of CPU time were used. 

This model was chosen as it has features that are simi- 
lar to those of the 3D Ising spin glass model for r<r3D. 



Table I: Parameters for the two-dimensional ±J Ising model 
ground state simulations. The precision is the number of bits 
used for floats, Nj is the number of disorder realizations, and 
m is the number of configurations per realization. 



Size L 


/3 (= 1/T) 


Precision 


Nj 


m 


8 


8 


1024 


4 X 10* 


1000 


16 


8 


1024 


4 X 10* 


1000 


32 


16 


1536 


2 X 10* 


400 


64 


16 


1536 


1 X 10* 


200 


128 


16 


1536 


5 X 10^ 


200 


256 


20 


2048 


2 X 10^ 


50 



The entropy difference AS* due to changes from periodic 
to antiperiodic boundaries along one axis is consistent 
with the behavior AS" - L^^ , with 0s ~ 0.50 [H 1^ . 
Zero energy excitations at scale £ are active only when 
their entropy is low enough, which occurs with proba- 
bility ~ so that spins at large separation have a 
preferred relative orientation with finite probability, al- 
lowing for long range spin-glass order |13j . In the droplet 
model of the 3D Ising spin glass, long range order for 
T < Tg^ results from the free energy cost of domain 
walls scaling as £^ , for some exponent 6 > [SHZ]. For 
the rest of this paper, the notation 9s will be replaced 
with 9 for a uniform presentation as the entropy domi- 
nates over energy; note that the energy exponent 9 fa 
for the bimodal 2D model [H IM]- With this replace- 
ment, the 2D simulations can parallel the behavior of 
the three-dimensional spin glass phase, though of course 
with a distinct value for 9. 

Numerical results. Randomly selected distributions 
Pj (q) are shown in Fig. [l] for the 2D T = model. For 
8 < i < 256, most samples have a peak at q « 0.7 — 0.8 
and some samples have peaks at smaller q. The peaks be- 
come sharper as the system size is increased. The average 
over realizations P{q) is plotted in Fig. [2] The location 
of the large-g peak can be fit by qea = 0.645 ± 0.01 with 
a L~-^/'^ correction 15 and a peak height described by 
~ L^/", with 1/0 w 0.4(1) over one decade in L. 

The computed P{q) for this model varies only slowly 
with L at small q. When comparing L = 8 with L = 16, 
more than 5 x 10'^ samples were needed to see a sta- 
tistically significant difference in P(0). This slow varia- 
tion with L resembles the results for the Ising spin glass 
phase in higher dimensions [HI [16], where the lack of 
visible variation has often been taken as evidence for a 
many-states picture. Fig. [3] shows the dependence on 
L of the integrated distribution I{qo) — Jq" P{q) dq for 
qo = 0.2. In the droplet picture, droplets of size ~ L ap- 
pear with frequency ^ , leading to the expectation 
that /(go) ^ at small qo < qEA- The data is consis- 
tent with this expectation for the range 64 < L < 256, 
but the logarithmic slope is less steep for smaller L. 



3 



20 



15 



10 



(a) L = 16 






(b)L 


= 128 


■A: 

! i 












^ — r"y."-'.--^-]S»i^ 


f\ i 
Ir- 

'% 


ST 


0.2 0.4 


0.6 


0.8 


0.2 


0.4 0.6 


0.8 





10 



Figure 1: Numerically sampled spin overlap distributions 
Pj{q) for six realizations J for the two-dimensional ±J spin 
glass at zero temperature for (a) L = 16 and (b) L = 128. 
The peaks at small q have comparable height in (a) and (b), 
but become narrower and so have less total area for larger L. 
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Toy model. One can study a toy droplet model, such 
as used in Ref. [5S], to explain these large corrections to 
scaling (also see |2l] for scaling of link overlaps in a hier- 
archical model). A given sample J is described by a set 
of active droplets: regions that have fixed relative spin 
orientations on their interior, but which are flipped with 
a probability of exactly 1/2 with respect to their exterior. 
Choosing this flip probability allows nested droplets to be 
decomposed into independent droplets |25j . The number 
of independent active droplets with volume between v 
and V + dv is simply taken to be n(v) dv — cv~^N dv for 
some prefactor c and an exponent x. In this calculation, 
dimensionality d enters only in the relationship between 
scale i and volume v ^ £'^. Choosing x = 2 + 6*/^ re- 
sults in a density of droplets of scale i proportional to 
£-d-e ^ in accord with the droplet picture. To generate 
a realization J', the number of droplets of size v is cho- 
sen from a Poisson distribution with mean n{v). These 
droplets are then randomly oriented to generate inde- 
pendent configurations. For < 9 < d, the asymptotic 
behavior of P{q) near g = is dominated by the largest 
droplets and so P(0) ^ L^^ . However, contributions to 
P(0) arise from each scale from L down to 1. Active 
droplets at scales below L can be numerous for small 9. 
As the number of such scales depends on L and the con- 
tribution from several scales below L can strongly con- 
tribute to P(0), the asymptotic behavior P(0) ^ 
may not be evident at small L. Plots of I{q — 0.2) 
for the toy model are included in Fig. [3] The prefac- 
tors c = 0.1 for {d,9) = (2,0.5) and c = 0.0375 for 
{d,9) = (3,0.21) are chosen to replicate accepted values 
of 9 and so that the peaks in the toy model P{q) are near 
q = 0.8 for L « 10. The magnitude of the local exponent, 
|Aln[J((7)]/Aln((7)|, which approaches 9 for large L, ex- 
ceeds 0.4 only for L > 64 for the 2D toy model. For the 
{d, 9) = (3, 0.21) toy model, the integrated density /(0.2) 
varies by less than 1% for 8 < i < 512, rather than the 
factor of « 2.4 given by asymptotic scaling; the magni- 
tude of the local exponent exceeds 0.1 for L > 3 x 10'^ 



Figure 2: (Color online) Plots of the sample-averaged P{q) 
for system sizes L = 8, . . . , 256. With increasing L, the peaks 
sharpen and the values at small q decrease, though slowly at 
smaller L. The error bars show 90% confidence intervals. 
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Figure 3: (Color online) A plot of 7(0.2), the cumulative dis- 
tribution through go = 0.2, vs. L, for sampled ground states of 
the ± J Ising model (error bars show 90% confidence intervals) 
and toy model simulations. The expected /(go < ?ea) ~ 
holds only for large L in the simulations and the toy model. 



and it exceeds 0.15 only for L > 3 x 10^. More detailed 
models can allow for lattice effects, the effect of boundary 
conditions on the density of large droplets, flip probabil- 
ities that are not 1/2, and interference between overlap- 
ping droplets, but such elaborations do not change the 
qualitative conclusion of large corrections for small 9 /d. 

Sample-dependent statistics. In order to more eas- 
ily use spin overlap data to decide the nature of states, 
a different statistic is now proposed. This statistic, the 
sample median I{q) of the integrated distribution func- 
tion Ij{q) — Pj{q')dq' , can be evaluated at each q. 
If I{q) at small q and large L vanishes, a many states 
picture cannot hold, as the fraction of samples that are 
macroscopically different from each other would neces- 
sarily vanish. In the RSB picture, for example, the ma- 
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Figure 4: (Color online) Plot of the median I{q) over realiza- 
tions J of the cumulative distribution Ij(q) for ground states 
of the 2D ± J Ising model. The values of L range from L = 8 
for the broadest curve to L = 256 for the narrowest curve. 
The error bars show 90% confidence intervals. The small val- 
ues of I{q) at small q do not agree with a many states picture 
for this model. Inset: toy model results for the same statistic. 
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Figure 5; Plots of A{qo, L), the probability that P{q) 
exceeds k in the range < g < go, vs. L for the 2D ±J Ising 
spin glass ground states, with k = 0.5 and 2 and go = 0.0625, 
0.125, and 0.25. For fixed go and k, this statistic can rise or 
decline with increasing L, due to the competition between the 
diminishing weight of peaks and the narrowing of the peaks. 



jority of samples have a positive I{q) at fixed small q and 
large enough L. The results for the 2D bimodal model 
are shown in Fig. ^ I{q) quickly vanishes with increas- 
ing L at small q < 0.2, though the convergence is slower 
at higher q. In the toy model with the 2D and 3D pa- 
rameters used here, /(g) is indistinguishable from zero for 
g < 0.4. The rise of /(g) narrows with increasing N, with 
a shift to lower g — )■ ggA as — ?► oo. One could also gen- 
eralize /(g) to Ix{q), the cumulative value Ix{q) exceeded 
by a fraction x of the samples, with /(g) — /i/2(g), to 
probe the distribution of Ij{q) in more detail. 

A recently introduced [T7] statistic is A(go,K,£), the 



fraction of samples where Pj{q) exceeds k in the range 

< g < go- This statistic was used to search for the mul- 
tiple peaks in P(g) that are expected to arise in a many 
states picture The value of A(go,K,L) was found 
[T7] to be roughly constant in L for small go and k for 
the three-dimensional Ising spin glass and to rise with L 
in the mean field Sherrington-Kirkpatrick model @] . The 
results of the simulations for two-dimensional Ising glass 
ground states are plotted in Fig. [5j Behavior very similar 
to that in the three-dimensional Ising spin glass is seen: 
A is nearly constant with L and can rise or fall slowly 
depending on the choice of k. Though the peaks in Pj{q) 
become less frequent and have less integrated weight as L 
increases, the peak height does not vary rapidly with L, 
so that this measure can be insensitive to the diminishing 
integrated weight over intervals of Pj(q). 

Conclusions. Numerical studies of the distribution 
of configuration overlaps in the two-dimensional bimodal 
(±J) Ising model at zero temperature and of a toy 
droplet model have been carried out. The 2D Ising model 
results show clear evidence for a single pair of thermody- 
namic states, despite the complexity resulting from en- 
ergetic degeneracies at each scale ^7\. But both models 
show very strong finite size corrections to scaling in most 
overlap statistics. These corrections are strong enough 
to make system averages of P{q « 0) nearly constant, 
instead of scaling as L^^ , for L < 500 in the toy model 
when using parameters consistent with the 3D Ising spin 
glass. In the two dimensional ±J model, system sizes 

1 > 64 are required to see behavior approaching the scal- 
ing predictions. The corrections seen in the toy droplet 
model result from the slow change with scale of the con- 
tributions to P{q) and the sum over scales from 1 to i. A 
parallel situation is that of strong corrections to scaling of 
average droplet energies that occur when averaging over 
droplet sizes |28j : domain walls introduced by boundary 
condition changes [SJ |B] show much smaller corrections to 
scaling. It may be useful to use similar L-scale measures 
of overlaps to clarify the convergence of P{q) in small sys- 
tems. A proposed statistic based instead on individual 
samples, the median /(g) over samples J/ of the cumu- 
lative distribution, is found to be nearly zero at small g 
even for small samples, allowing such samples to provide 
much more convincing evidence for a single pairs picture. 
It would be of interest to employ this statistic to com- 
pare the mean-field Sherrington-Kirkpatrick model and 
the three-dimensional Ising spin glass model. 
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